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The exponential inequalities are obtained for the distribution tails of canon- 
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from a stationary sequence of observations satisfying 99-mixing. 
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1. INTRODUCTION. PRELIMINARY RESULTS 

The paper deals with estimates for the distribution tails of U- and U-statistics 
with canonical bounded kernels, based on samples of stationary observations un- 
der (^-mixing. The exponential inequalities obtained are a natural generalization of 
the classical Hoffding inequality for the distribution tail of a sum of independent 
identically distributed bounded random variables. The approach of the present pa- 
per is based on the kernel representation of the statistics under consideration as a 
multiple orthogonal series (for detail, see [SI IS])- It allows to reduce the problem 
to more traditional estimates for the distribution tail of a sum of weakly dependent 
random variables. 

Introduce basic definitions and notions. 

Let Xi, X2, ... be a stationary sequence of random variables taking values in an 
arbitrary measurable space {X, A}, with the common distribution F. In addition 
to the stationary sequence introduced above, we need an auxiliary sequence {X*} 
consisting of independent copies of X\. 
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Denote by L 2 (£ m , F m ) the space of measurable functions f(ti, . . . , t m ) defined 
on the corresponding Cartesian power of the space {£, ^4} with the corresponding 
product-measure and satisfying the condition 

E/ 2 (X*,...,X;)<oo. 

Definition 1. A function f(t\, . . . , t m ) G L2(X m , F m ) is called canonical (or degen- 
erate) if 

E x *J(X* l ,...,X*J = a.s. (1) 

for every k, where Ex* is the conditional expectation given the random variables 
{X*;i<m,i^k}. 

Define a Von Mises statistic (or V- statistic) by the formula 

V n = V n (f) := n~ m/2 J2 f(X h ,...,X jm ). (2) 

l<ji,—,j m <n 

In the sequel, we consider only the statistics where the function f(ti,..., t m ) (the so- 
called kernel of the statistic) is canonical. In this case, the corresponding Von Mises 
statistic is also called canonical. For independent {Xi}, such statistics are studied 
during last sixty years (see the reference and examples of such statistics in [9j). In 
addition to ^-statistics, the so-called [/-statistics were studied as well: 

U n = U n (f):= n~ m l 2 J2 /(-V, V,.. ). (3) 

Notice also that any [/-statistic is represented as a finite linear combination of 
canonical [/-statistics of orders from 1 to m. This representation is called Hoffding 's 
decomposition (see [9]). 

For independent observations {Vj}, we give below a brief review of results di- 
rectly connected with the subject of the present paper. In this connection, we would 
like to mention the results in [3, Theorem 1], [21 Proposition 2.2], [1] Theorem 7, 
Corollary 3], and [3, Theorem 3.3]. 

One of the first papers where exponential inequalities for the distribution tails 
of [/-statistics are obtained, is the article by W. Hoffding [8] although he considered 
nondegenerated [/-statistics only. In this case, the value {n — m)\/n\ equivalent to 
n~ m as n — > oo, is used as the normalizing factor instead of n~ m l 2 . In [8], the 
following statement is proved: 

F(U -EU>t)< e - 2fc * 2 /(^) 2 , (4) 
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where 



U = {n-m)\/n\ £ f(X h , . . . , X im ) 



a> < f(ti, ■ ■ ■ ,t m ) < b and k = [n/m]. In the case m = 1, inequality (jlj) is usually 
called Ho ff ding 's inequality for sums of independent identically distributed bounded 
random variables. Notice that, in this case, the sums mentioned may be simultane- 
ously considered as canonical or nondegenerate [/-statistics. 

In [3], an improvement of (jlj) was obtained for the case when there exists a 
splitting majorant of the canonical kernel under consideration: 

/(ti,...,U| < Uditi), (5) 

i<m 

and the function g(t) satisfies the condition 

Eg(X 1 ) k < a 2 L k - 2 k\/2 
for all k > 2. In this case, the following analogue of Bernstein's inequality holds: 

(4-2/m \ 
- ff2+L V n -/^ < 6 » 

where the constants c% and C2 depend only on m. Moreover, as noted in [3] , inequal- 
ity (j6j) cannot be improved in a sense. 

It is clear that if sup t . f(ti,...,t m ) = B < oo then, in (jSJ), one can set 
a = L = B l l m . Then it suffices to consider only the deviation zone \t\ < Bn m l 2 
in ([6]) (otherwise the left-hand side of turns into zero). Therefore, for allt > 0, 
inequality §6§ yields the upper bound 



p(|K 



> /) <ncxp(-|(t/B) 2 / ro ) (7) 



which is an analogue of Hoffding's inequality (jlj). 

In [2], an inequality close to (jSJ) is proved without condition (jSJ), and relation ([7]) 
is given as a consequence. In [7j, some refinement of (J7|) is obtained for m — 2, 
and in [TJ, the later result was extended to canonical ^-statistics of an arbitrary 
order. The goal of the present paper is to extend inequality (j7|) to the case of 
stationary random variables under y9-mixing. For dependent observations, we do 
not yet know how to get more precise inequalities close to Bernstein's inequality (J6j), 
for unbounded kernels under some moment restrictions only. 
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2. MAIN RESULTS FOR WEAKLY DEPENDENT OBSERVATIONS 



In the sequel, we assume that X is a separable metric space. Then the Hilbert 
space L 2 (X,F) has a countable orthonormal basis {e;(t)}. Put e (t) = 1. Us- 
ing the Gram-Schmidt orthogonalization, one can construct an orthonormal basis 
in 1/2 (X, F) containing the constant function eo(t) = 1. Then Eej(Ai) = for every 
i > 1 due to orthogonality of all the other basis elements to the function eo(t). The 
normalizing condition means that Eef(-Xi) = 1 for alH > 1. 

In the sequel, we assume that the basis consists of uniformly bounded functions: 

sup\ ei {t)\<C. (8) 

i,t 

It is well-known that the collection of the functions 

{^(h^fe) ■ ■ -e im (t m ); z" 2 , • • • , V = 0, 1, . . . } 

is an orthonormal basis of the Hilbert space L2(X m , F m ). The kernel f(t±, . . . , t m ) 
can be decomposed by the basis je^^i) • • -ej m (t m )| and represented as a series: 

oo 

f(t 1 ,...,t m )= J2 fii,...,im e ii{ti)---e im {t m ), (9) 

il,...,im=l 

where the series on the right-hand side converges in the norm of /^(X™, F m ). More- 
over, if the coefficients {fi u ...,i m } are absolutely summable then, due to the B. Levi 
theorem and the simple estimate E e^pf*) ■ ■ ■ ej m (A^J < 1, the series in ([9]) con- 
verges almost surely with respect to the distribution F m of the vector (X£, . . . , X^). 
It is worth noting that, even in this case, we cannot extend this statement to the 
distribution of the vector with dependent coordinates (Xi, . . . , X m ). Note also that 
eo(t) is absent in representation ([§]) because the kernel is canonical ( for detail, 
see [5]). 

Thus, by (jUj), we can represent the corresponding Von Mises statistic (J2J) as 
follows: 

Vn = n~ m / 2 £ f(Xl,...,X*J 

l<3U~jm<n 



-m/2 

n 1 



E E fil,— ,im e il{-^-ji) ' ' " e «tre(^j' m ) 

l<ji,---,jm<n h,...,im=l 



E h ,-J> 1 2 E ^ " • • n- 112 E e im (X*) 

il,...,i m =l j=l j=l 



E fii,...,i m S n {i\)---S n 
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where S n (i k ) := n" 1 / 2 E?=i e ik (X*), k = l,...,m. 

In the present paper, we consider only stationary sequences {Xj} satisfying ip- 
mixing condition. Recall the definition of this type of dependence. For j < k, denote 
by 971^ the a- field of all events generated by the random variables Xj, . . . , X k . 

Definition 2. A sequence X\, X2, . . . satisfies (p-mixing (or uniformly strong mix- 
ing) if 

\¥(AB)-f(A)¥(B)\ 
<p{i) := sup sup — — ► 0, 1^ 00. 

fc>i A&m\,B&m™ +i ,w(A)>o ir[/i) 

Remark 1. If {Xj} satisfies (p-mixing with the coefficient <p(k) then the sequence 
f(Xi), /(X2), . . . for every measurable function f also satisfies (p-mixing with the 
coefficient no more than (p(k). 

Introduce some additional restrictions on the mixing coefficient and the kernels 
of the statistics under consideration: 

1- (A) Y°° u ...,i m =i \fh,..,iJ < °° an d <p(k) < c e" cifc2 , where c x > 0. 

2. (B) There exists e > such that J2i? ... t m =i l/u,...,i m | 1_e = c < 00; and 

ip :=^(p{k) < 00. 

The main results of the present paper are contained in the following two theo- 
rems. 

Theorem 1. Let a canonical kernel f(ti, . . . , t m ) be continuous (in every argument) 
everywhere on X m and let condition (J2j) be fulfilled. Moreover, if one of conditions 
(A) or (B) is fulfilled then the following inequality holds: 

P(|K| >x) <C 1 exp{-C 2 x 2 / m /B{f)}, (10) 

where C2 > depends only on <£>(-); in case (A), 



2/m 



and in case (B), 



B(f):=[C m J2 \hr 

il,...,i m =l 



B(f):=c 2 [ y: \fiu 

iii,...,i m =l 



m(l-e) 



|l-e 



here the constant C is defined in (TJI) 
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Remark 2. Under condition (A), we may set C\ = 1. Under condition (B), the 
value C\ depends on the constants m, e, c, and C . The dependence on the values c 
and C can be removed by considering "large enough" values of x, namely, satisfying 
the inequality 

x 2 ' m > £ - 1 8m(l - e)eCV 2/Ml - £)) . 

The following theorem is an analogue of statement ( fTUI) for [/-statistics. 

Theorem 2. Let the sequence X\,X 2 , . . . satisfy the following condition: 

(AC) For every collection of pairwise distinct subscripts ji, ■ ■ ■ , j m , tie distribution 
of (Xj 17 . . . , Xj m ) is absolutely continuous with respect to the distribution of 
(X*, . . . ,X^). 

Moreover, if the basis { e i(*)} >0 satisfies restriction ((2J) and one of the two condi- 
tions (A) or (B) is valid then 

P(|Z7„1 > rr) <C x exv{-C 2 x 2 ' m /B{f)), (11) 

where, under condition (A), the constants C% and C 2 are the same as in Theorem 1, 
and under condition (B), the constant C\ depends on m, e, c, and C, and the constant 
C 2 depends on (f and m; the value B(f) is defined in Theorem 1. 

3. PROOF OF THE THEOREMS 

Proof of Theorem 1 . Without loss of generality, we assume that a separable metric 
space X coincides with the support of the distribution F. The last means that X 
does not contain open balls with F- measure zero. Since all the basis elements ek(t) 
in (jUJ) are continuous and uniformly bounded in t and k, due to Lebesgue's domi- 
nated convergence theorem, the series in is continuous if the coefficients fi lt ...,i m 
are absolutely summable. It is not difficult to see that, in this case, the equality 
in ([9]) turns into the identity on the all variables ti,...,t m because the equality 
of two continuous functions on an everywhere dense set implies their coincidence 
everywhere. So, in this case, one can substitute arbitrarily dependent observations 
for variables ti,...,t m in identity Therefore, for all elementary events, the 
above-mentioned representation holds: 

oo 

VnU) = E fh,-,i m Sn(k) ■ ■ ■ S n (i m ), (12) 
il,...,i m =l 

where, as above, S^i^) ■— n~ l l 2 Yjj=i e i k (Xj), k = 1, ...,m. 
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(I) We first prove the theorem under condition (A). Consider an arbitrary even 
moment of the Von Mises statistic using representation (|T2|) : 



EV 



2N 



oo 

ei fix, 



'2mJV-ra+lv^ ! 2mJV 



ESJit) ■ ■■SJi 



2mN , 



Further, we have 



(13) 



ES n {ii) ■ ■ ■ S n {i2mN) 



< n 



-mN 



£ Ee il (X, 1 )---e l2mJV (X 



]2mN , 



2mN 



n 



-mN 



E E 



E 



r=l ki<-- <k r <n Sj(i):i<r,j<2mN 



where 



and 



Vu. 



T\x k 



S2mN(i) , 



2mN 



(14) 



r 2mJV 

x; e *iW = 2mN - 

i=i i=i 

Notice that, for a fixed r, the number of all collections of such Sj(i) that % runs 
from 1 to r and j runs from 1 to 2mN, coincides with the number of all different 
arrangements of 2mN indistinguishable elements in r cells when every cell must 
contain at least one element. It is well known that this value equals 



Cr— 1 
■ 



(2mN - 1)! 



2mN-l 



(2mN -r)\(r- 1) 



Lemma 1. If {Xi} satisfies ^-mixing and restriction (A) is valid then, for every 
collection . . . , ^mv}; the following inequality holds: 



\mN 



ES n (ii) ■ ■ -SnfamN) < (cC mN) 



where c depends only on the mixing coefficient <£>(•). 

Proof. We will estimate every summand of the external sum over r in (fT4j) (taking 
the normalization n~ mN into account). The approach is quite analogous to that in 
the proof of the corresponding assertion in [H Lemma 4]. 



7 



If r < mN then the number of the collections k\ < ■ ■ ■ < k r < n equals C r n and 
does not exceed n r < n mN . Hence, 



n - mN ^ ^|e^-..^ 

ki< - <k r <n sj(i) 



r~i2mN r~ir— 1 



Now, let r > mN. Fix an arbitrary collection of Sj (i) and consider the inner subsum 
in dH]): 

E |E^ n ---^ n |. (15) 

Here 1 < V\ < v% < r and v :— V2 — v% + 1 is the multiplicity of the corresponding 
subsum, and the blocks are defined as before. Denote 

V2 2mN 

E E s i(*) = ^1^2)- 

Notice that, for v\ < I < v 2 , we have 

^,0+^ + 1,^)= ^1,^2). 
In the sequel, we will call v^. a short block if 

2mN 

E s i(«) = 

.7 = 1 

i. e., z/fc. = ej.(Xfc.) for some 1 < j < 2mN. Prove the following statement: If 
the number of short blocks in the summands of subsum (|T5l) is no less than d G 
{0,1, ... ,v} then the following estimate is valid: 

E lEHkn • • • ^ I < {c2d) d/2 - 2 n v - d l 2 C K ^\ (16) 

where C2 depends only on the mixing coefficient. Prove it by induction on d for all 
v\ and t>2 such that v < r. First, let d = 1, i. e., the moments in (115]) contain at 
least one short block. Denote it by v^, where k Vl < h < k V2 . In addition, set 



lieii* = (E|tf) 



i/t 
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Then the following estimate holds: 

<2 E </ ?1/2 (^+i - • • 

+ e E e 

fcu-L <---<fe;<n fci + i<---<fc„ 2 <ra 

oo 



Vk l+1 ■ ■ ■ v kv2 



i=l 



k vi < --<ki<n 



l-l, 



"k vi ■ ■ ■ v hl _ x 



1J h 



< 2n v - 1 C K(vi ' V2) ^T<p 1/2 (i) 

i=l 

oo 

+ 2n V2 - l C K « +1 ' v * ) ri- Vl C K ( Vl >V e v? 1/2 

oo 

i=l 
oo 

<4j2v 1/2 (i)n v - 1/2 C K ^' V2) 



8=1 



1=1 



what required to be proved. The induction base is proved. 
Now, let the inequality 

E P&V • • • ^ I < (c^*' 2 " V"*/ 2 ^^ 

hold for all the minimal possible numbers z < d of the short blocks and all the 
multiplicities v, and the moments in (|15|) contain no less than d short blocks. Denote 
these blocks by z^, . . . , z^. . Consider d — 1 pairs of neighbor blocks of the type 
z/fc js , ^fc is+1 , s = 1, ■ ■ ■ , d — 1. Denote the differences between the subscripts in these 
pairs by t\, . . . , £<z-i respectively. Among the summands in (fT5|) . select d — 1 classes 
(in general, intersecting). We have 

E ^k n ■ ■ ■ Vk V2 <Ri-\ h -Rd-i, 

fe<u-i <C ■ ■ ■ < Ck<w2 

where the subsum R s is taken over the set of subscripts 

I s '.= ^y(k Vl , . . . , k V2 ) : k vi < • • • < k V2 < n, t s = maxtj|. 
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We estimate every subsum R s as follows: 

R s < 2 E V 1/2 (k ja+1 - k js ) \v kvi •••u kj 



Vk js+1 ■ ■ ■ v kv2 



+ E | E *V-^| E \^k ]s+1 ---v kv2 

k vi <—<kj s kj s +i<--<k V2 

Consider the first sum on the right-hand side of (jTTI) . We have 
2 ¥ 1/2 ( k js+i ~ k js ) \\v kn ■ ■ ■ Vh js IJI^+i • • • V K, " 



(17) 



2 1 1 2 



< 2C K{vi > V2) n v - d+1 p 1/2 (k)k d - 2 < 2C K{V1 



k=l 



k=l 



d-2 



< 2C K{vi > V2) n v ~ d+1 c / e - cit2/2 t d - 2 dt 



< 



Co 



Jd-l)/2 
c l 



qK (vi ,v 2 ) v-d+1 y 



d-1 



The last inequality holds due to the evident fact that there exists a constant C3 such 
that T(t) < est 1 ' 4 . 

Now, consider the product of sums on the right-hand side of ffTTj) . Let the 
summands in the first of these sums contain d\ short blocks selected above. Cor- 
respondingly in the summands of the second sum, there are d — d\ selected short 
blocks. By construction, we have 1 < d\ < d — 1, so, for both the sums, we can 
apply the induction assumption. So we have 

EEza, ■■■vu. Eza. . , • • • IA. 

kv-^<^.'"^kj B kj s -^\^" n< ^kv<2 

< (c 2 di) dl ^ 2 ~ 2 C K( - Vl,js "'n j3 ~ Vl+1 ^ dl ^ 2 

x (c 2 (d - rf 1 )) { ^ l)/2 ' 2 ^^ +1 ^)n^-^-( d - dl )/ 2 

< (c 2 df 2 - 4 C K ^ V2) n v - d/2 . 

Combining the estimates for the two sums on the right-hand side of f|T7|) . we have 

R s < (c 2 d) d/2 - 3 C K ^ V2) n v - d ^ 2 . 
Summing all the values R s , we conclude that 

E ■ • • u kv2 <(d- l)(c 2 df 2 -*C K ^n v - d / 2 



<-<kv 



< {c 2 d) d ' 2 - 2 C K ^ v ^n v - d / 2 
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what required to be proved. The last step is true only if c 2 > 1 but we can assume 
this condition to be satisfied without loss of generality. 

Now, note that if r > mN then, in the summands in (jT4i) . there are no less than 
2(r — mN) short blocks. Thus, setting in (TT6l) v \ := 1, v 2 := r, d := 2(r — mN), and 
v := r, we get the following estimate: 

n -mN £ £ . . . ^| < C -] v _ in -^ (c2rf) ^2- 2n -^/2^K,, 2 ) 

fel<— <k r <n Sj(i) 

< 2 2mN -\c 2 2mN) mN - 2 C 2mN < (%c 2 ) mN - l C 2mN (mN) mN - 2 . 
Summing over all r from 1 to 2mN in ( fl4j) . we conclude that 

E5 n (i0---5 n (i 2miv )| < (8c 2 ) miV - 1 C fflmiV (mJV) mJV . 
The lemma is proved. □ 
By this lemma, we estimate the even moment of the Von Mises statistic in (fT3l) : 

/ oo \ 2JV 

:^; 2V < E i/u,..,j (£c 2 mivr^. 

\ii,...,i m =l / 

Apply Chebyshev inequality: 

2N 



P K. > x) < < 



EV 2N (Sg , ,...,i m= il/t 1 ,-,t m |C m ) gnAQ 



mAT 



X 2iV ~~ X 2N 

Set iV = ex 2 l m for some e > 0. Then 

2N 



rm > x) < g^!! 

= exp |em ln(c4me)x 2//m |, 

where 

/ oo \ 2 / m 

C4 = £ E l/ii,..,dcH =£B(/). 
\ii,...,j m =i / 

It is easy to verify that the multiplier emhi{c^me) reaches its minimum at the point 
£ = (c4me) _1 , and this minimal value equals — (c4e) _1 . Then 



P(|K| > x) < exp{ - {cB{f))- l x 2 ' m } 



what required to be proved. 

(II) Now, prove the theorem under condition (B). Formulate the following aux- 
iliary statement from J6j Proposition 5] adapted to our conditions: 
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Theorem 3. Let Y±, Y2, . . . be a stationary sequence of random variables taking 
values in R and satisfying (f -mixing condition, and let \Yx\ < C with probability 1. 
Then, for all t > 0, the following relation holds: 



P 



Y^Y-nEY, 



i=i 



> t J < e 1/e exp 



Set 



a 



\fii,—,im\ ' if fii,—,i m 7^ 0; 

v 00, if /ii,...,^ = 0. 

We also agree that 0/0 = to make the following relation correct: 

l-e 



fh,...,i m a h,---,i 

Obviously, 

00 00 

E a ii,...,i m — E 

Further, evaluate the tail probability: 



/il,.. 



«l,...,i m =l 



p(|V n (/)| >z) =p| 



«i,...,i m =l 



<W E |/n,... > ^n(il)--^n(0 XT 1 * £ |/ n 



ii,...,i m =l 



> X 



Ira l^ll,...,tm 



ii,...,i m = l 



ii,...,i m =l 



< ]T Pf 5 n (^)---5 n (z m ) 

»i,...,i m =l 
00 j 

< £ (p(|5 n (z 1 )|>(c™ 1 xa n ,..., m ) 1 /™) + ... 
+ P(|£ n (z m )| > (c-^,...,^) 1 /™)). 



;is) 



E ./",..:.,... <■ (19) 



Taking into account condition (jSJ) and the fact that, for every fixed basis func- 
tion e»(t), the sequence {e^Xj)}^ satisfies ^-mixing condition (Remark 1), we can 
set Yfc = e»(Xfc) in Theorem 3 and use inequality ( fl8l) to estimate the probability 

P(|5' n (i)| > (c- 1 ^,...,^) 1 /™). So, we have 

P(X(i)| > (c-'zai,,...,^) 1 ^) < e 1/e exp 



l6eC*E n k ={(n-kMk) 



<e l ' e 



e 1 exp 



-n(c ^a,!,...,^) 27 " 1 
!QeC 2 nE n k ZW(k) 



< e 1/e exp 



(C 



\2/m 



16eCV 
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If ctii,...,i m = oo then both the parts of this inequality are equal to zero. Note that 
the estimate above does not depend on the argument % of S n (i). Therefore, in the 
sequel, we will use the notation S n (l) only. Consider the multiple series from (fl9l) : 

oo 

E-(l-e)/e 
<X/ = c < oo. 



*l\,...,lr, 



il,...,i m =l 



It follows from the series convergence that its elements can be order in decrease, 
and hence, the sequence {a^,...,^} can be order in increase. Denote the well-ordered 
sequence by {Pi}. Obviously, 



and thus, 



1=1 



A > 



-{l-e)/e 



C, 



i\e/(l-e) 



So, taking the above-mentioned arguments into account, we can obtain the estimate 



/ 1 / 

P(|K(/)| >x) <m^P (\S n (l)\ > (c- 1 ^) 

<m]TP(|£ n (l)| > (rt^c- 1 )^ 1 ^) /m 



i=l 



< me 1//e V] exp 



i=l 
oo 



.^e/(l-e) c -l/(l- 



2/m. 



me 



16eCV 

1 / e ^exp(-ir(a;)z 2£ /( m ( 1 - £ ))); 



8=1 



here 



x 



2/m 



16eCVc 2/(m(1_£)) ' 

Denote 7 = 2e/ (m(l — e)). We first consider such a; that 'yKix) > 1 (it is clear that, 
in this case, x > x for some x ). We get 



OO n QQ 

E exp ( - K(a;)i 7 ) < e - x(x) + / e" 
i=i 



Jf (*)t7 ^ 



7 Ji 



If 7 > 1 then 

1 Z" 00 

7 A 



e -«"(*)« u V7-l du<- 

7 Ji 



1 /-oo f3 —K{x) 

1 e -^du= — <e- K{ - x \ 



jK(x) 
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Otherwise, set / = [I/7 — 1] + 1. Notice that I < K{x). Then 

I r°° e -K{ X) u u iH-x du <l r°° e -K{. x) u u i du 
7 Ji 7 Ji 

e- K ^ ( I 1(1-1) l\ \ 

~ jK(xj V + K(xj + K 2 (x) + " ' + Ri(x) ) 

Thus, the theorem is proved for x > Xo-To do the statement of the theorem true 
for all nonnegative x, it suffices to increase C\ so that the inequality 

C 1 exp{-C 2 x 2 /m /B(f)}>l 

holds. Then, for x < Xq, we obtain 

P(|K(/)| > x) < 1 < C x e~ c ^ m l B ^ < Cl e~ c ^ 2,m l B{ -l\ 

Theorem 1 is proved. □ 

Proof of Theorem 2. As noted above, the series in ([9]) converges almost surely with 
respect to the distribution of the vector (X*, . . . ,X^) if the coefficients fi lt ... t i m are 
absolutely summable. It is clear that condition (AC) allows to claim the same on 
the distribution of the vector (Xj 1 , . . . ,Xj m ) for every pairwise distinct subscripts 

Jli ■ ■ ■ 1 3m- 

Since, in the summation set in the definition of [/-statistics, all the subscripts are 
pairwise distinct, we can substitute the series in (jSJ) for the kernel in expression Q. 
So we obtain 

00 

Un= fh,-,im J2 e h( X h)--- e im(X jm ). 

ii,...,j m =l l<ii^— =£jm<n 

Under condition (A), the proof repeats the previous one almost literally. Estimating 
the even moment of the statistic in the same way, we can obtain an upper bound for 
the multiple sum of mixed moments of the basis elements, which appear as a result 
of raising the [/-statistic to the corresponding power. The difference between the 
right-hand side of (I14p and this expression is in the absence of certain summands 
from ffMl) with multiple subscripts in the later multiple sum. Since all the summands 
on the right-hand side of (fT4"j) are non-negative, this is an upper bound for the above- 
mentioned mixed moment. Hence the moment 

E J2 e h( X h) ■ ■ ■ e im (X jm ) ■ ■ ■ e i2 mN -m + A X h)'-- e i2 m N( X i m \ 
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does not exceed the expression obtained in Lemma 1. From here the statement of 
Theorem 2 follows in the case (A), with the same constants as those in Theorem 1. 

Now, consider the situation when condition (B) is fulfilled. Notice that, by 
adding and subtracting the corresponding diagonal subspaces in the summation set, 
one can represent the expression 



(20) 



as a sum of products of the following values: 

n 1 n 

-r=J2 e i( X i)i - J2 e h(X j )e i2 (X j ), . 



n 



k/2 



3=1 



For convenience, denote the last of this sum as S n (ii, . . . ,ip.)- Thus, we represent 
the [/-statistic as a sum of Von Mises statistics (of the same or lesser orders and, 
perhaps, nondegenerate in case under consideration). Notice that the number of 
summands here depends only on m. It is worth noting that the first summand of 
this decomposition of the multiple sum in fTSOj) is the product S n {ii) • • • S n (i m ). Then 
we realize the proof in the same way as the proof of Theorem 1 for the case (II). 
The probability 



P 



> c xa 



%l,...,tn 



is estimated by the sum of probabilities of the type 



P 



5 l ki 



S n (i r 



m—k a +l i 



) > c l xa ily .. tim /K(m) 



Here K(m) is the above-mentioned number of summands which depends only on m; 

. . . , i l m } is a permutation of the subscripts {«!,..., i m }, and k\ + ■ • • + k s = m. 
Estimate such a summand, for simplicity, omitting the superscripts and denoting 
by a the right-hand part of the inequality inside the last probability. Then 



P 



Sn(^li • • • i ^k\^j ' ' ' S n (j"m—k B +li • • • j ^rn*j 



> a 



< P 



S n (ii, ■ ■ ■ 



> a kl/m \ +••• + ?( 



^m—ks+1 ) ■ ■ ■ ) V, 



> a 



ks/m 
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Using Theorem 3 and the fact that the value S n (ii, ■ ■ ■ ,ik) (and consequently, its 
expectation) does not exceed C k /n k / 2 ~ 1 , we obtain the estimate 



P 



S n (ii, ■■■,h) 



> a 



< e 1/e exp 



= e 1/e exp 



-(a k ^ m -C k /n k / 2 - 1 ) 2 n k 
lGeC 2k mp 



_ j a k/m _ fjk j n k/2-l \~ ,,A— J 

16eCVC 2(fe_1) 



It is easy to see that, for every fixed x, beginning from some n, the argument of the 
last exponent does not exceed the value 



-a 



2/m 



16eCV 



Then it remains to repeat the proof of Theorem 1 for this case. Theorem 2 is 
proved. □ 
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